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Claim 

In an encoder for transform coefficients that are obtained wherein image data are divided 
into blocks, the above-mentioned blocks are further divided into a plurality of sub-blocks 
obtained by sub-sampling the respective different pixel positions, and the above-mentioned 
sub-blocks are orthogonal-transformed, an image encoding device characterized in that within the 
above-mentioned plurality of sub-blocks, it encodes the transform coefficients for the first block 
as is, and for the sub-blocks other than the above-mentioned first sub-block, it encodes the error 
portion between those transform coefficients and the transform coefficient for the 
above-mentioned first sub-block. 



Detailed explanation of the invention 
Industrial application 

This invention relates to a high-performance-rate encoding device that compresses digital 
image data, and is used in communications and filing systems. 

Prior technology 

in recent years, the change to high-capacity recording media such as magnetic and optical 
disks, and to high-definition displays, has accelerated, and with these, the demand for image data 
filing has increased. In the area referred to as binary data filing, text filing devices have already 
become widespread. However, in the case of multilevel image data, the recording capacity of 
recording media has expanded by leaps and bounds, but their data amount is large, and they are 
difficult to put to practical use as filing devices that must compress the image data. In regard to 
the compression of multilevel image data, there was previously "band compression" that was 
made to analog compress the transmission frequency; as the technology for integrated circuits 
and the like advanced, the signal was quantized, made into digital image data having n bit 
gradations, and compressed. One application example of the latter is orthogonal transform 
encoding that takes notice of the fact that there are correlations in an image, divides the image 
data into blocks, executes orthogonal transform, and after that quantizes the transform coefficient 
(Japanese Kokai Patent Application No. Sho 61 [1986]- 123280). 

Below, [this] is explained using a figure. The conventional example is shown in Figure 7. 
In Figure 7, (71) is an image memory section, (72) a block readout section that reads out n x n (n: 
integer) image data from the image memory, (73) an orthogonal transform section that 
orthogonal-transforms the block data, (74) a quantizing section that quantizes the transform 
coefficient obtained by means of the transform, (75) an encoding section that encodes the data 
coefficient that was quantized, and (76) is the encoded data. The image data are read out at each 
block by means of the block readout section (72) from the image memory (71), those block data 
are orthogonal-transformed by means of the orthogonal transform section (73), and in the 
literature referenced here, a discrete cosine transform (Hereinafter, called DCT) is executed. 
Then, that transform coefficient is quantized and encoded at the quantizing section (74) and the 
encoding section (75). To reproduce the image, the conventional example reverses the encoding, 
the transform coefficient is reproduced by means of decoding and reverse quantizing from the 
encoded data, and blocks of corresponding image data are reproduced from that transform 
coefficient. Also, [when] the conventional transform encoding device shown here is applied to an 
image file; for example, using a thumbnail image in an image search, to make that thumbnail 
image, it is necessary to reproduce all the image data, then reduce and use it as the thumbnail 
image, or separately create and encode a thumbnail image. 



Problems the invention is to solve 

In creating a thumbnail image in the image field, the conventional example of the 
transform encoding device encounters problems in the computation or memory efficiency, such 
as in reconstruction from the original image for the creation of a separate image. 

Means to solve the problem 

The present invention, to solve the above-mentioned problems in an encoder for 
transform coefficients obtained wherein image data is divided into blocks, the above-mentioned 
blocks are further divided into a plurality of sub-blocks obtained by sub-sampling the respective 
different pixel positions, and the above-mentioned sub-blocks are orthogonal-transformed, within 
the above-mentioned plurality of sub-blocks, it encodes the transform coefficients for the first 
block as is, and as for the sub-blocks other than the above-mentioned first sub-block, it encodes 
the error portion between those transform coefficients and the transform coefficient for the 
above-mentioned first sub-block. 

Operation 

By reproducing a portion of the sub-blocks that construct a block using the 
above-mentioned method, a reduced image can be reproduced with good efficiency as a 
thumbnail image, and by means of further reproducing the remainder of the sub-blocks, the entire 
image can also be obtained with good efficiency. 

Application examples 

Below, an application example of the present invention is explained using the figures. 
Figure 1 is a recording-encoding block diagram for image data for one application example of the 
present invention, and in this same figure, (1) is an image memory section, (2) a block readout 
section, (3) a sub-block readout section, (4) an orthogonal transform section, (5) a transform 
coefficient compressing section, (6) a quantizing section, (7) an encoding section, and (8) is the 
encoded data. Figure 2 is a reproduction-decoding block diagram for image data. In this same 
figure, (8) is the encoded data, (9) a decoding section, (10) a reverse quantizing section, (1 1) a 
transform coefficient expanding section, (12) a reverse orthogonal transform section, and (13) is 
an image memory. In Figure 3(a) a detailed block diagram of the transform coefficient 
compressing section is shown, and in Figure 3(b), a detailed block diagram of the transform 
coefficient expanding section is shown. Figure 4 shows one example of a sub-sampler in this 
invention, and in this same figure, (a) is the original image, and (b to e) show the respective 
sub-blocks. In Figure 5, an encoded data construction example of this invention is shown. In this 
same figure, (a) is the encoded data for each sub-block of 1 block, and (b) shows the encoded 
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data for one image. In Figure 1, the image that is to be encoded is divided into blocks from the 
image memory (1) and read out at the block readout section (2). Those data are shown in (a) of 
Figure 4. In this same figure, (x, y) show the positions of the pixels within the respective blocks. 
In the figure, the O mark shows the P ixel > md the sub-blocks are constructed by means of pixel 
groups having the same digit within the O- The data for the block m <" vided into sub-blocks 
and constructed by means of the sub-block readout section (3). That construction is as shown in 
Figure 4. In this same figure, the pixel construction for the sub-blocks is shown in (b to e), and 
the block data are constructed by the pixels obtained by sub-sampling every other pixel. If the 
sub-blocks are constructed in this manner, the image data for each sub-block become analogized. 
That sub-block is orthogonal-transformed at the orthogonal transform section (4). In the 
transforming of the image data, execution of discrete cosine transforms is the most common, and 
in this case also, it is used as an example. 

Since the sub-blocks are analogized image data, the transform coefficient also becomes 
analogized. By using that distinctive feature, the compression process for the transform 
coefficient for the sub-block group is conducted at the transform coefficient comprising section 
(5). Those details are shown in Figure 3(a). In this same figure, (31) shows the transform 
coefficient for a sub-block, (32) a memory that temporarily stores a reference sub-block 
transform coefficient, (33) a subtracting section, (34) shows the subtraction results, and the 
memory (32) takes an initial value of 0 at the transform starting time for the block. First, as for 
the transform coefficient for the reference sub-block that is obtained from the orthogonal 
transform section (4), since the initial value of the memory (32) is 0, even if subtracted at the 
subtracting section (33), a coefficient is taken as is as the result (34), and sent to the quantizing 
section. At that time, the transform coefficient for the reference sub-block is stored in the 
memory (32). At the transform coefficient for the next sub-block, the differential with the 
transform coefficient corresponding to the reference sub-block is taken sequentially one pixel at a 
time by means of the subtracting section (33), and those error data only are sent as the results to 
the quantizing section. In this way, transform coefficients for other than the reference sub-blocks 
become only the differential portion with the transform coefficient corresponding to the reference 
sub-block, and since the transform coefficient for the sub-block is analogized, that error is also 
small, and that coefficient becomes compressed. The coefficient that is compressed by means of 
the coefficient compressing section (5) in this way is quantized by means of the quantizing 
section (6). In the case of quantizing, in those in which the value of the coefficient that was sent 
to the quantizing section (6) is small, the number of quantizing bits is small, and in those that are 
large, the number of bits are mostly shared and quantized. For example, in the transform 
coefficient for the reference sub-block, most of the bits are shared, and as for the error 
coefficients for the sub-blocks outside of that, since their value is also small, a small number of 
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bits is shared. In Figure 5(a), an encoded data construction example for one block is shown, and 
in (b), the encoded data construction example for the data for one image is shown. In this same 
figure, (a) shows the encoded data for the transform coefficient of the reference sub-block of 
Figure 2(b) [sic; possibly, Figure 4(b)], and (B to D) are the encoded data for the error 
coefficients for the transform coefficient of the sub-blocks shown by Figure 2(c to e) [sic; 
possibly Figure 4(c to e)] and the transform coefficient of the reference sub-blocks. The encoded 
data obtained in this manner are communicated or stored in memory. In this case, the encoded 
data group for the transform coefficients for the reference sub-blocks such as that of Figure 5(b) 
are also examples that are initially transmitted or recorded. An explanation is given in regard to 
reproducing or receiving these data, and reproducing an image. In Figure 2, a 
reproduction-decoding block diagram of the image data is shown. In this same figure, the 
encoded data (8) are decoded by means of the decoding section (9), and the transform coefficient 
and error coefficient are reproduced by means of the reverse quantizing section (10). As for that 
reproduced transform coefficient and error coefficient, the error coefficient is expanded to the 
original coefficient at the transform coefficient expanding section (11). A detailed block of the 
transform coefficient expanding section (1 1) is shown in Figure 3(b). In this same figure, (35) 
shows the reproduced transform coefficient and error coefficient, (36) is a memory that 
temporarily stores the reference sub-block transform coefficient, (37) an adding section, and (38) 
shows those addition results, and the memory (36), at the time of starting the coefficient 
transform for the block, takes an initial value of 0. First, as for the transform coefficient for the 
reference sub-block that is obtained by means of the reverse quantizing section (10), since the 
initial value of the memory (36) is 0, even if it is added at the adding section (37), the coefficient 
is taken as is as the result (38), and is sent to the reverse orthogonal transform section (12). At 
that time, the transform coefficient for the reference sub-block in the memory (36) is temporarily 
stored at each block. In regard to the error coefficient for the sub-block, by using the transform 
coefficient for the reference sub-block corresponding to that sub-block, the sum of the reference 
sub-block transform coefficient is taken by means of the adding section (37); as a result of that, it 
becomes its original transform coefficient, and those data are sent to the reverse quantizing 
section. Here, to explain the reproduction of the thumbnail image, the image data are initially 
reproduced using only the transform coefficient for the reference sub-block. When this is done, 
an image for 1/4 of the original image data is reproduced. That picture is shown in Figure 6. In 
this figure, (a) is the original image, and (b) is its 1/4 image. The image data that are reproduced 
in this manner can be made the thumbnail image in a search process for a file system. Also, the 
error data corresponding to the transform coefficient for the other sub-blocks are decoded, and by 
adding the transform coefficient of the sub-block that has already been reproduced, the transform 
coefficient for these sub-blocks are obtained, and by subsequent image reproducing, the original 
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image can be reproduced. By means of the present invention, the creation of a thumbnail image 
from one portion of the decoded data can be done, and by reproduction in addition to the data for 
that thumbnail image, the original image can be reproduced. In this application example, the 4 
sub-blocks construct the block, but for example, this can be made 16, and in the case of 
reproducing the original image, step-like image reproduction is possible wherein image 
reproduction proceeds from l/16th the original image, to l/4th, then finely detailed reproduction. 

Effects of the invention 

As in the above, in the present invention, the reproduction can be carried out with good 
efficiency of a thumbnail image using a portion of the encoded data of the original image, as well 
as step-like image reproduction. 

Brief description of the figures 

Figure 1 is a process flow chart for the recording-encoding of image data in an image 
encoding device of one application example of the present invention, Figure 2 is a 
reproduction-decoding block diagram for the image data in this same device, Figure 3 is a block 
diagram of the transform coefficient compressing section and expanding section in the device, 
Figure 4 is a diagram showing one example of a sub-sample in the device, Figure 5 is a 
construction diagram of the encoding data in the device, Figure 6 is a diagram showing a 
reproduced image example in the device, and Figure 7 is a process flow chart for an image 
encoding device of a conventional example. 

1 Image memory section 

2 Block readout section 

3 Sub-block readout section 

4 Orthogonal transform section 

5 Transform coefficient compressing section 

6 Quantizing section 

7 Encoding section 

8 Encoded data 



7" n .v 7 



ft * 4fc 



« * * 



Figure 1 



Key: 1 Image memory section 

2 Block readout 

3 Sub-block readout 

4 Orthogonal transform 

5 Transform coefficient compressing 

6 Quantizing 

7 Encoding 



r 



* * * to 



/0 



/2 



■13 



Figure 2 

Key: 9 Decoding 

1 0 Reverse quantizing 

1 1 Transform coefficient expansion 

1 2 Reverse order orthogonal transform 
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Figure 5 

Key: 1 Reference sub-block 

2 Other sub-blocks 

3 Encoded data construction example for one block 

4 Coefficient encoding data for reference sub-block group 

5 Error coefficient encoding data for other sub-block groups 

6 Encoding data construction example for one image 
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